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reported  herein.  In  RPV  Study  VII,  the  main  interest  was  in  the  composition 
of  three  teams  of  five  operators  each:  do  independent  teams  whose  individual 
members  belont;  to  one  team  perform  differently  from  teams  whose  members  are 
chosen  from  a  limiteo  pool  of  operators  such  that  each  operator  performs  on 
two  teams.  In  RPV  Study  VIII,  another  aspect  of  team  compostition  was  investi¬ 
gated:  how  is  the  performance  of  an  individual  operator  reflected  in  the 
performance  of  a  team  and  across  teams  of  varying  sizes.  In  both  studies,  the 
operators  were  highly  experienced  in  the  control  of  the  simulated  RPV  system. 
Both  studies  employed  scenario'-,  requiring  that  support  RPVs  provide  coverage 
for  a  set  of  weapon  del  i  very 'strike  RPVs.  The  RPV  system  was  assumed  to 
operate  in  an  environment  where  a  radio  frequency  has  to  be  shared  by  multiple 
users,  so  that  a  time  slot  for  command  and  telemetry  transmissions  becomes 
available  for  RPV  system  use  only  on  a  periodic  basis.  The  results  of  RPV 
Study  VII  indicated  that  average  performance  remained  unchanged  from  independ¬ 
ently  constituted  teams  to  pooled  constituted  teams.  However,  the  variablity 
in  terms  of  standard  deviations  of  dependent  measures  was  reduced.  The  re¬ 
sults  of  RPV  Study  VIII  indicated  that  operator-centered  tasks  are  largely 
unaffected  by  team  size,  and  that  highly  trained  operators  are  unaffected  by 
team  size  on  the  same  tasks.  Workload,  in  terms  of  the  number  of  RPVs  to  be 
controlled,  had  an  effect  on  performance  by  itself  but  had  no  differential 
effect  over  team  sizes  or  operators. 
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1.0  INTRODUCTION 


1.1.0  The  AFAMRL  RPV  Systems  Simulation  and  Research  Program  was  initiated 
in  April  1973  in  response  to  requirements  for  support  of  the  design  of 
the  man-machine/environment  interface  of  Air  Force  advanced  RPV  systems 
capable  of  simultaneous  control  of  large  sets  of  RPVs.  As  such,  its 
major  objectives  were  of  the  applied  type  such  as  evaluating  alternative 
design  configurations,  assessing  RPV  systems  effectiveness,  providing 
engineering  data  for  systems  design.  While  the  results  of  the 

current  study  can  still  be  used  for  such  applications  as  systems  design, 
the  emphasis  has  shifted  over  time  to  provide  basic  research  support  to 
AFAMRL's  Systems  Technology  Development  Program  and  a  new  set  of 
objectives  has  emerged: 

1.1.1  Develop  a  team-in-the-loop  computer  simulation  capable  of 
emulating  a  real-world  system.  Such  a  system  then  becomes  a 
laboratory  instrument  or  "guinea  pig"  for  experimental 
manipulation  and  observation. 

1.1.2  Develop  a  methodology  of  data  analysis  and  interpretation 
which  is  valid  and  useful  for  the  study  of  large-scale  systems. 

1.1.3  Conduct  exploratory  studies  to  provide  insight  into  the 
behavior  of  systems  and  the  construction  of  simulations  and  models 
of  systems. 

1.2.0  The  two  studies  reported  herein  were  designed  to  address  two  issues 
in  the  area  of  systems  modeling/simulation  construction.  The  ultimate 
objective  of  work  in  this  area  is  to  provide  guidelines  pertaining  to  how 
one  goes  about  constructing  a  model  or  simulation  of  a  complex  system. 
(Note:  The  term  "system"  that  is  being  used  here  is  intended  to  include 
human,  hardware,  and  environmental  components  that  are  interactive  over 
time.  ) 
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I.i'.l  The  first  study,  RPV  Study  VII,  was  designed  to  explore  an  issue 
(it  team  (i.e.,  crew)  composition:  Do  teams  perform  differently  depending 
upon  wtiether  or  not  they  are  independent  of  one  another  in  terms  of 
operator  involvement?  Teams  of  operators  may  be  assumed  to  be  independent 
of  each  other  if  no  individual  operator  is  a  member  of  more  than  one  team 
i,  i  . e . ,  independently  constituted  teams).  However,  suppose  an  investigator 
iriust  construct  a  set  of  teams  from  a  limited  pool  of  available  operators 
!iy  random  assignment,  forcing  a  situation  where  individual  operators  are 
members  of  more  than  one  team  (i.e.,  pool^ed  constituted  teams).  Such  a 
I  i^e  is  not  unrealistic  when  one  considers  a  research  program  involving  a 
m  am- in-f  fie- loop  system  simulation  and  the  following  primary  constraints: 

(a)  1.  inn  ted  funds  to  support  a  large  number  of  teams,  (b)  limited  long- 

feiiii  iva  i  I  ab  i  1  i  ty  of  operators  who  are  experienced  (have  been  trained) 
witfi  tlie  complex  tasks  of  a  system  simulation,  and  (c)  limited  management 
■it'.u.,  sclieduling)  flexibility  such  that  the  greater  the  number  of  operators 
“mployd,  tfip  greater  are  the  management  problems.  Thus,  in  many  cases, 
if  rnigfit  be-  desirable  to  organize  teams  from  a  small,  well-trained  pool 
or  op.'iraLors  that  can  more  easily  be  managed  over  a  long  period  of  time, 
dri.vo.'t,  doing  so  also  means  that  team  performance  will  be  intercorrel  ated 
’n  'vii:ic  mjnner  and  will  violate  the  assumption  of  independence  among 
teaiir  for  statistical  analysis  and  generalization  purposes.  Specifically, 
ffif.n,  RPV  Study  VII  provides  a  comparison  between  system  simulation 
[It  or  on  !  mro  obtained  from  independently  constituted  teams  (three,  h- 
ptocoii  f earns)  and  performance  obtained  from  pooled  constituted  teams 
(Hu  op,  o-[i(,Tson  teams  in  which  operators  were  members  of  two  teams). 


1.2.2  The  second  study,  RPV  Study  VI II,  was  also  desiuned  to  explore 
issues  of  team  composition:  (a)  Does  an  operator  perform  differently  a- 
a  function  of  team  size,  and  (b)  does  team  performance  vary  with  team 
size?  The  first  issue  can  be  stated  differently.  RPV  Study  VIII 
provided  data  on  the  existence  or  nonexistence  of  transfer  functions 
between  the  performance  of  operators  working  alone  and  the  performance  of 
the  same  operators  on  team  of  varying  sizes.  The  importance  of  this 
first  issue  may  not  be  inmediately  obvious.  In  constructing  models  and 
fast-time  simulations  of  systems,  one  is  generally  confronted  with  trying 
to  obtain  data  that  are  relevant  to  teams  or  multi-operator  performance. 
However,  the  literature  provides  very  little  of  these  kinds  of  data. 

Instead,  most  of  the  literature  contain  reports  of  studies  of  individual 
subject  performance  (or  performance  obtained  by  collapsing  over  individuals  . 
It  is  also  true  that  actually  developing  a  literature  data  base  pertaiti  inn 
to  all  types  of  team  sizes  and  situations  would  be  quite  impossible.  It 
has  been  generally  assumed  that  one  or  more  transfer  functions  exist 
between  single  and  multiple  operator  performance  as  well  as  between  teams 
of  various  sizes.  If  this  were  found  to  be  true,  it  would  be  of  cons i der ih  1  •' 
value  to  systems  model  and  fast  time  simulation  builders. 

1.3.0  This  technical  report  summarizes  the  data  of  the  seventh  and  eighth 
RPV  systems  simulation  studies  (RPV  Study  VII  and  RPV  Study  VIII)  c-n:ployinq 
the  AFAMRL  RPV  System  Simulation  Test  Bed. 

2 . 0  AF_AMRL_  Rf_V_  SmEM  SIMULATION  TEST  BED 

2.1.0  RPV  Study  VII  and  VIII  employed  the  AFAMRL  RPV  Systems  Simulation 
Test  Bed.  The  simulation  incorporates  a  large  number  of  the  parameters 
of  a  postulated  real-world  RPV  system.  The  simulation  employs  four  En 
Route/Return  Phase  operators  and  one  Terminal  Phase  Pilot  operator  (henceforth 
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referred  to  as  Pilot).  Each  En  Route/Return  operator  monitors  and 
operates  a  computer  graphics  terminal  (IBM  ?2‘j0)  comprised  of  a  graphic 
display  (Cathode  Ray  Tube,  CRT),  alphanumeric  keyboard,  light  pen,  a 
programmable  function  keyboard,  and  a  small  panel  for  hand-over  actions. 
The  pilot  ooerates  a  pilot  station  comprised  of  basic  flight  instruments, 
a  joystick  for  controlling  a  video  camera  over  a  terrain  model,  and  a 
closed  circuit  TV  monitor.  Ttie  simulation  is  executed  in  real-time  and 
permits  simultaneous  control  of  up  to  35  simulated  RPVs. 

2.2J'  Figure  1  is  a  schematic  layout  of  the  simulation  facility  as  it 
was  configured  for  ttiese  studies.  Note  that  the  video  camera  can  be 
control  led  either  manually  in  a  continuous  control  mode  or  it  c.an  be 
posii  ioned  by  the  computer. 


POSITION 


Figure  1.  H'JMA:!  EIIGIMEERING  SYSTEMS  SIMULATOR  FACILITY  CONFIGURATION 


6 


?.3.0  The  RF’Vs  ar'o  pre'.uim>d  to  bo  <  .ipahlc  of  opeo  .it  i tii|  in  two  imi  .Ii  -  ; 

tifst,  the  I  1  i()hf.-i)at  h-fo  I  low  (ri'T)  . . .  .uul  '.toorid.  Mu  ■  roi  t  j  i ;ir 

oorurol  (CC)  nuido.  In  the  Fl'f  mode,  f(u.-ro  !■.  a  -  el  of  oi-o'ji'apii  o^al 
coot'dinate  points  stored  in  ihe  memory  of  the  sn.ml.itfd  RPV  and  it  flies 
throiKjh  ‘hese  points.  This  process  is  co-ipletely  automatic  and  ‘elf- 
contained  with  control  signals  coming  from  the  simolated  on-lj(jaid 
navigation  system.  In  the  CC  mode,  control  signals  are  produced  by  the 
pilot  and  are  transmitted  by  radio  to  the  RPV.  With  video  foodhatk 
available,  this  allows  highly  accu'^ate  guidance  to  the  target. 

2.4.0  The  AFAMRL  RPV  systems  simulation  can  be  briefly  characterized  in 
terms  of  the  major  submodels  tiiat  are  dynamically  interfaced  in  the 
simulation.  These  submodels  are  listed  below. 

2.4.1  Simulated  RPV  heading,  altitude,  and  velocity  flight 
parameters.  The  updating  of  the  system  status  is  automatic  and 
occurs  in  discrete  time  increments  (to  be  discussed  later). 

2.4.2  Three  data  links  (Command,  Position  Reporting,  and  Video) 
for  each  simulated  RPV  and  with  interference  •'arameters . 

2.4.3  Simulated  RPV  Fuel  load  and  rate  of  usage  as  a  function 
of  velocity  and  altitude. 

2.4.4  Simulated  RPV  attrition  probability  parameters  based  on 
altitude  and  on  the  extent  of  (lateral)  cross  track  deviation 
from  the  programmed  flight  plan. 

2.4.5  Simulated  RPV  subsystem  reliability  operating  in  real 
"operational"  time  in  conjunction  with  a  simulated  RPV  inventory. 

2.4.6  Simulated  RPV  navigation  system  parameters  for  Inertial. 
Doppler,  and  Basic  Dead  Reckoning  systems. 

2.5.0  Specific  and  detailed  displays  and  controls  available  in  the 

■/ 


(S12  indicates  strike  RPV  i2),  a  listing  of  RPV  tail  numbers  and 
associated  information  down  the  right  side  of  the  display,  a  status 
information  block  in  the  lower  left  corner,  and  two  other  message  blocks 
in  the  lower  center  and  the  lower  right  areas.  Operators  also  have  the 
capability  to  window  (zoominq)  around  an  RPV  at  two  display  scaling 
levels.  Each  En  Route/Return  operator  can  make  use  of  all  control  devices 
(i.e.,  light  pen,  alphanumeric  keyboard,  programmable  function  keyboard, 
and  the  hand-over  switch  panel). 

3 . 0  RPV  MISSION  SCENAR^ip  f ARAMJ^RS 

3.1.0  RPV  Study  II  (Mills  et  al.,  1975a)  employed  a  "genet ai  i/ed"  mission 
scenario  intended  to  establish  base-line  data  and  represented  a  cross- 
section  of  specific  scenarios  in  that  it  contained  system  task  elements 
expected  to  be  present  in  most  real-world  RPV  missions.  RPV  Study  111 
(Mills  et  al ,  1975c)  employed  a  slightly  more  specialized  mission  scenario 
assuming  that  a  limited  set  of  support  RPVs  (Electronic  Warfare  and  Low 
Altitude  Reconnaissance)  would  be  available  for  coverage  of  a  set  of 
strike  RPVs  or  manned  aircraft.  RPV  Study  IV  (Aume  et  al.,  1976)  continued 
to  use  this  type  of  mission  scenario.  RPV  Study  V  (Aume  et  al..  1977  ) 
and  RPV  Study  VI  (unpublished)  used  equal  numoer'  of  Strike,  [lectriMOi. 
Warfare,  and  Low  Reconnaissance  RPVs,  and  required  that  the  maximum 
number  jf  Electronic  Warfare  RPVs  be  used  to  provide  coverage  tc  ‘■•ach 
Strike  RPV.  RPV  Study  VII  continued  to  use  this  scenario.  RPV  "^tudy 
VIII  used  an  equal  number  of  Strike  and  Electronic  Warfare  RPVs  (Lnw 
Altitude  Reconnaissance  RPVs  were  not  used)  and  required  coverage  by  t  lie 
maximum  number  of  EW  RPVs. 

3.3.0  The  parameters  of  the  RPV  mission  scenario  for  RPV  Studies  VII  ar,: 
VIII  are  listed  below.  (The  specific  differences  in  scenarios  for  the 
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two  studies  are  relatively  unimportant.  The  changes  were  made  principally 
I'C!  ause  of  iiianageiiient  considerations.) 

3.?.1  RPV  Launch  and  recovery  phases  are  assumed  to  occur  "outside"  the 
simulation.  RPVs  are  launched  from  one  of  three  launch  points  in  RPV 
Study  VII  and  from  two  launch  points  in  RPV  Study  VIII,  and  all  are 
recovered  at  one  point. 

^.2.2  Each  RPV  has  its  own  preprogrammed  flight  plan  that  is  assumed  to 
lie  stoied  both  in  the  Drone  Control  Facility  and  the  RPV  computers. 

Each  flight  plan  is  assumed  to  be  optimal  with  respect  to  terrain 
and  defenses.  Thus,  the  Mission  Planning  subsystem  is  also  assumed  to  be 
out. side  the  simulation. 

5.3.4  Eacfi  RPV  is  designated  one  of  three  mission  types:  Strike 
(Wpap.ms  Delivery),  EW  (Electronic  Warfare),  and  Low  Recce  (Low  Altitude 
Recsinnai ssance ) . 

3., '.5  A  round  trip  of  approximately  300  NM  per  RPV  is  simulated,  with 
liic  center  of  the  target  area  located  150  NM  from  the  launcfi  insert  irui 
.ind  rocovcr'y  coordinates.  Strike  and  Low  Recce  RPVs  field  quite  closely 
U>  their  path  lengths.  EW  RPVs,  due  to  repeated  passes  over  laiqets, 
■raveled  i.ons  iderably  farther  than  t  tie  preprogrammed  path  length. 

3.3.6  Each  RPV  has  an  initial  command  velocity  of  350  knots  and  a 
command  altitude  of  200  feet.  Both  velocity  and  altitude  are  variable  at 
ffir  (/(irrator- ' s  discretion:  Velocity  between  300  and  400  knots  and 
altitude  between  0  and  10,000  feet. 

■././'  The  RPVs  arc  launctied  according  to  type.  The  group  of  EW  RPVs  ace 
I  lupriM  ,'|  first  on  15-second  intervals.  These  are  followed  by  the 
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Low  Recce  (RPV  Study  Vll  only),  also  on  15-second  intervals.  The  Strike 
Group  is  launched  la^t  on  3-minute  intervals.  The  total  number  ot 
vehicles  is  parameteric  and  is  determined  prior  to  each  mission,  there 
being  an  equal  number  of  vehicles  in  each  grcup. 

3.2.8  There  was  a  task  requirement  that  each  Strike,  EW,  ar.d  Low  Recce 
group  must  be  time-phased  (coordinated  arrivals)  to  target.  Time-phasing 
is  such  that  as  many  LW  RPVs  as  possible  must  be  within  a  5  NM  radius  of 
the  target  assigned  to  the  Strike  and  (in  RPV  Study  VII  only)  a  single 
Low  Recce  must  follow  the  Strike  vehicle  after  2  minutes  (simulating 
BDA).  These  coordination  requirements  are  discussed  in  paragraph  5.5.1. 

3.2.9  Each  Strike  flight  plan  has  a  redesignated  waypoint  S  for  cueing 
the  start  of  hand-off  procedures.  Next  comes  the  hand-off  (H)  waypoint 
at  which  the  vehicle  "enters  the  target  area"  and  the  pilot  can  acquire 
continuous  control  over  it  as  well  as  receive  TV  returns  froiTi  it.  In 
addition,  each  Strike  flight  plan  has  a  designated  Target  (T,  one  ot 
three  targets),  Hand-Back  (B),  and  Recovery  (R)  coordinates. 

3.2.10  In  the  RPV  Studies  VII  and  VIII  scenarios,  the  EW  flight  plctns 
are  programmed  through  all  three  targets  (labeled  1,  ?,  and  3).  No 
other  waypoints  are  designated  on  these  flight  plans  (except  th.^ 

Recovery  coordinate). 

3.2.11  Prior  to  hand-off,  an  RPV  is  given  a  command  to  climb  to  an 
altitude  of  3000  ft.  For  Strike  RPVs,  the  small  area  on  the  terrain 
model  also  required  a  change  in  command  velocity  to  300  knots. 

3.2.12  On  Strike  flight  plans  the  distance  from  S  to  H  is  10.0  NM;  from 
H  to  T,  the  distance  is  1.5  NM. 

3.2.13  Each  RPV  is  given  just  enough  fuel  to  complete  the  round  trip 
mission.  Strike  and  Low  Recce  RPVs  are  assigned  a  fuel  load  of  2200 
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pounds.  EW  RPVs  are  assigned  a  load  of  3880  pounds.  (NOTE:  These 
values  may  seem  a  bit  unrealistic;  however,  the  original  simulation 
assumed  an  advanced,  large  tactical  RPV  of  F4  size.) 

3.2.14  RPV  position  reporting  error  was  b'-’b  ft  range  error  and  0.6 
milliradian  azimuth  error.  The  RPV  lateral  deviation  alarm  threshold 
values  were  fixed  at  1000  ft. 

3.2.15  The  simulation  included  a  function  to  smooth  raw  RPV  position 
reporting  data.  The  smoothing  function  essentially  fits  a  statistical, 
best-fit  flight  path  to  position  reports.  (If  more  detail  is  desired, 
see  ttie  Instruction  Manual  noted  in  2.4.0.) 

3.2.16  The  simulation  included  a  function  to  perform  automatic  RPV 
heading  correction  based  on  smoothed  position  report  data.  The 
automatic  correction  is  ordered  for  an  RPV  when  the  lateral  deviation  or 
cross  track  error  is  in  excess  of  1000  ft.  The  lateral  deviation  of  an 
RPV  is  measured  relative  (perpendicular  distance)  to  its  stored  flight 
plan.  (See  the  Instruction  Manual  noted  in  2.4.0  for  more  detail.) 

3.2.17  Both  of  the  above  functions  (3.2.15  and  3.2.16)  are  assumed  to 
occur  at  the  RPV  Control  Facility  and  noj,  onboard  the  RPV.  This 
"smarter"  RPV  system  was  initiated  in  RPV  Study  III  and  has  been 
continued  in  all  subsequent  RPV  studies. 

3.3.0  Figure  3  depicts  the  profile  of  a  typical  scenario  used  in  RPV 
Studies  VII  and  VIII.  In  this  figure,  a  group  consisting  of  Strike  and 
EW  and  (for  RPV  Study  VII),  Low  Recce  flight  plans  are  shown.  In  this 
situation,  the  EW  and  Low  Recce  RPVs  are  to  rendezvous  with  the  Strike 
RPV  at  Target  T.  As  one  of  the  task  requirements  is  to  provide  coverage 
by  the  maximum  number  of  FW  RPVs,  these  vehicles  are  orbited  in  the 
vicinity  ot  the  target  (to  avoid  a  cluttered  figure,  only  one  EW  RPV 


is  shown).  The  EW  RPV  shown  in  the  figure  has  previously  covered  a 
Strike  RPV  at  Target  T2.  After  covering  Target  T1 ,  it  is  being  turned 
back  for  additional  coverage.  To  provide  the  necessary  coverage  at  the 
targets,  the  operators  are  required  to  reroute  (reprogram)  EW  RPVs  such 
that  the  rendezvous  with  the  incoming  Strike  RPV  will  occur  according  to 
time-phasing  requirements  (to  be  identified  later). 

4.0  CO NTR OL/p  I SPLA S 

4.1.0  Each  En  Route/Return  operator  station  consists  of  an  IBM  2250 
Graphics  CRT  terminal.  These  terminals  are  equipped  with  a  12-i.'ich  CRT, 
light  pen,  alphanumeric  keyboard,  and  a  programmable  function  keyboard. 

A  small  panel  of  switches  and  lights  has  been  added  to  each  terminal  for 
operator  control  during  hand-offs. 

4.2.0  The  pilot's  station  is  equipped  with  a  joystick,  basic  flight 
instruments,  and  a  TV  monitor  which  alternately  displays  either  imagery 
from  the  terrain  during  the  final  flight  to  target  or  information  from 
one  of  the  CRT  terminals  during  other  portions  of  a  mission. 

4.3.0  Each  CRT  has  the  capability  to  display  flight  plans,  track 
signatures,  etc.,  for  up  to  10  RPVs  simultaneously.  How  many  and  which 
items  of  information  are  displayed  are  at  the  operator's  discretion. 

RPV  status  parameters  such  as  velocity,  fuel  remaining,  RPV  type,  etc., 
are  displayed  for  one  individual  RPV  at  a  time.  Other  displayed 
parameters  are  ETA  to  the  next  designated  waypoint,  flight  mode  for  each 
RPV  in  the  system,  and  elapsed  mission  time. 

4.4.0  Operators  can  "call"  displays  and  can  make  changes  to  RPV  flight 
parameters  using  the  various  control  devices  and  can  make  changes  to 
RPV  flight  parameters  using  the  various  control  devices  on  the  terminals 
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For  example,  in  the  case  of  heading  changes  the  operator  can  employ  any 
one  of  the  three  window  sizes  (a  50x50  NM,  a  100x100  NM  which  arc  (frifored 
on  the  RPV  to  bo  changed,  and  a  ?00x200  NM  window  which  is  centered  on 
the  entire  geographical  area).  The  operator  then  introduces  a  set  of 
points  (not  to  exceed  10)  on  the  CRT  face  using  the  light  pen.  The  point- 
to-point  distances  are  also  displayed.  The  heading  changes  always  start 
from  the  current  RPV  position  and  must  end  on  a  "reconnect"  point  on  the 
original  flight  path.  This  constitutes  an  "attempted"  heading  change. 

If  the  operator's  prescribed  points  call  for  an  impossibly  tight  turn 
according  to  the  g-load  value  specified  for  the  RPV,  the  computer  rejects 
the  set  of  points  and  sounds  on  audio  alarm.  The  operator  must  then 
introduce  a  new  set  of  points  or  the  RPV  continues  unchanged.  Valid 
heading  change  commands  are  transmitted  over  the  simulated  command  data 
link  to  the  onboarc  computer  and  the  RPV  proceeds  to  fly  through  the 
points  prescribed  in  the  command. 

4.5.0  Each  attempt  to  communicate  an  instruction  to  an  RPV  employs  the 
command  data  link.  The  possible  commands  are  altitude  changes,  velocity 
changes,  navigation  system  changes,  destruct,  deploy  chutes,  and  headinq 
change.  After  a  command  is  entered,  it  remains  displayed  in  the  "out¬ 
standing  commands"  block  until  it  has  been  transmitted  to  the  RPV. 

4.6.0  The  displayed  position  of  each  RPV  is  in  the  form  of  a  track 
signature  consisting  of  a  heading/velocity  vector  and  an  ID  number.  The 
displayed  position  is  computed  by  adding,  vectorially,  the  position 
reporting  system  error,  navigation  system  error,  as  compounded  by 
operator  error,  to  the  true  RPV  position.  Figure  2  shows  a  typical 
track  signature  for  RPV  No.  12,  drawn  considerably  off-course,  to  make 
it  clearly  distinguishable. 
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5.0  OPERATOR  RESPONSIBIL ITES  AND  PROCEDURES 

5.1.0  En  Route/Roturn  operators  are  required  to  perform  the  following 
general  tasks. 

5.1.1  Monitor  the  progress  of  the  simulated  mission. 

5.1.?  Coordinate  (adjust  arrival  times)  all  RPV  arrivals  to 
the  target  and  recovery  areas. 

5.1.3  Time-phase  each  Strike  RPV  such  that  it  achieves  its 
"original"  ETA  (assigned  during  flight  plan  generation)  to  each 
designated  waypoint  (S,  H,  T,  B,  R).  To  achieve  a  maximum  number 
of  hand-overs  to  pilot,  some  deviations  are  permissible  (also  see 

5.6.1  ). 

5.1.4  Time-phase  RPV  recoveries  such  that  EW  and  Low  Recce 
RPVs  arrive  at  R  in  any  order.  Strike  achieves  original  ETA  to 
R,  and  the  ar-rival  interval  of  all  RPVs  is  not  less  than  15 
seconds  apart. 

5.1.5  Perform  hand-offs  to  other  operators  when  required. 

5.1.6  Accept  RPVs  (on  a  passive  basis)  handed  off  by  other 
operators . 

5.1.7  Hand-back  RPVs  upon  request  from  another  operator. 

5.1.8  Respond  to  RPV  failures,  e.g.,  by  Destruct,  Deploy 
Chutes,  Switch  in  back-up  navigation  system,  etc. 

5.1.9  Reprogram  (recycle)  RPVs  to  replace  RPVs  that  are  lost 
due  to  malfunction,  attrition,  etc.  Strike  and  Low  Recce  RPVs 
are  replaced  only  if  lost  during  En  Route  to  target. 

5.1.10  Manage  RPV  fuel . 

5.2.0  ETA  adjustment  for  an  RPV  is  accomplished  by  the  operator  altering 
RPV  velocity  and/or  RPV  heading  (i.e.,  increasing  or  decreasing  RPV 
flight  path  distance).  Reprogramming  an  RPV  is  accomplished  by  causing 
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the  replacement  or  support  RPV  to  go  to  the  new  target  area  after  it  tia:, 
completed  its  assigned  miss  on.  A  replacement  RPV  must  be  of  the  same 
type  as  the  lost  RPV  and  must  be  time-phased  with  the  remaining  RPVs  oi 
the  group.  A  group  of  RPVs  consisted  of  a  Strike,  EW,  Low  Recce  triad 
for  RPV  Study  VII  and  a  Strike,  EW  pair  for  RPV  Study  VIII.  Additionally, 
a  replacement  strike  RPV  must  be  assigned  to  the  same  target  as  the  lost 
strike  RPV. 

5.3.0  The  pilot  is  required  to  perform  the  following  general  tasks. 

5.3.1  Direct  coordination  ot  RPV  hand-offs  and  arrivals  to 
target  and  recovery  areas  during  "dead-time"  of  en  ro  ite  and 
return  phases  of  tlie  mission. 

5.3.2  Accept  Strike  RPVs  from  En  Route/Return  operators. 

5.3.3  Switch  into  Video  and  rontirmous  Control  modes  when 
a  Strike  RPV  .is  successfully  h.inded-off. 

5.3.4  Perform  target  acquisition  and  simulate  1 ine-of-sight 
target  lock-on  for  weapon  release  (activate  trigger  switch). 

5.3.5  Perform  hand-back  of  a  Strike  RPV  following  the 
Terminal  Phase. 

5.4.0  Target  detection  and  acquisition  requ i I'ement s  were  minimal  during 
the  Terminal  Phase.  This  was  due  to  the  large  number  of  repeated  runs 
to  the  same  targets  and  the  small  area  of  the  terrain  model.  At  the 
present  time,  the  lack  of  significant  detection  and  acquisition  problems 
is  not  viewed  as  a  serious  deficiency.  These  simulation  btudies  are 
concerned  with  the  dynamic  interaction  of  the  major  elements  of  mission 
phase  integration,  multiple  RPVs,  near  simultaneous  hand-offs,  multiple 
operator  interactions,  etc. 
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6.b.0  A  successful  hand-off  could  occur  (a  Strike  RPV  achieves  continuous 
L-introl)  only  if  tfie  RPV  was  within  a  +1500  ft  wide  corridor  on  both 
sides  of  the  flight  path  to  the  target. 

5.6.0  There  were  a  number  of  performance  requirements  which  the  RPV 
system  was  expected  to  achieve.  These  were  prioritized  for  the  operators. 
Operators  were  instructed  that  in  order  to  achieve  the  criterion  of  highest 
priority,  some  accuracy  might  have  to  be  sacrificed  on  lower  priority 
items.  Furthermore,  each  team  (see  5.7.0)  was  allowed  to  employ  its  own 
strategy  tor  meeting  the  criteria. 

5.6.1  The  general  requirement  in  RPV  Study  VII  was  to  deliver  each  Strike 
RPV  to  target  with  as  many  EW  RPVs  within  f i v^  njiujMcal  mile  radius  of 
the  , orcesponcli ny  target  as  possible  and  followed  2.0  minutes  +15  seconds 
liter'  by  a  single  tow  Recce  RPV.  The  major  priorities  of  the  RPV  Study 
V  I  1  W'jr  e ; 

5.6.  1.1  Maximize  the  number  of  Strikes  achieving  target  and 
di't'.ieving  the  criterion  of  maximum  numbei'  of  EWs  within  a  5  NM 
radius  of  target  and  a  Low  Recce  fly  over  target  2.0  minutes 
•*15  seconds  later. 

5.6. 1.2  Maximize  the  number  of  Strikes  achieving  target  with 
cov'erage  by  a  maximum  number  of  EWs  within  a  5  NM  radius  of  target 
with  slippage  in  the  Low  Recce  criterion. 

5.6. 1.3  Maximize  the  number  of  Strikes  achieving  target  with 
(.ov'-rage  by  at  least  one  EW  within  a  5  NM  radius  of  target  and 
also  achieving  the  Low  Recce  criterion. 

5.6.  1.4  Maximize  the  number  of  Strikes  achieving  target  with 
co'.orage  by  at  least  one  EW  within  5  NM  radius  of  target  and  with 
slippage  in  the  Low  Recce  criterion. 
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5. 6. 1.5  Maximize  the  number  of  Strikes  achieving  target  with  Fw 
coverage  but  no  Low  Recce  coverage. 

5. 6. 1.6  Maximize  the  number  of  Strikes  achieving  original  FTAs 
and  minjmi^  Strike  lateral  error. 

5. 6. 1.7  Maximize  the  number  of  Strikes  achieving  target. 

5.6.2  The  general  requirement  in  RPV  Study  VIII  was  to  deliver  each 
Strike  RPV  to  target  with  as  many  EW  RPVs  within  a  five  nautical  mile 

target  as  possible.  (The  Low  Recce  type  of  RPV  was 
eliminated  in  RPV  Study  VIII.)  The  major  priorities  of  RPV  VIII  were; 

5.6.2. 1  Maximize  the  number  of  Strikes  achieving  target  and 
achieving  the  criterion  of  maximum  number  of  EWs  within  a  5  NM 
radius  of  target. 

5. 6. 2. 2  Maximize  the  number  of  Strikes  achieving  target  with 
coverage  by  at  least  one  EW  within  5  NM  radius  of  target. 

5.6.2. 3  Maximize  the  number  of  Strikes  achieving  original  ETAs 
and  minimize  Strike  lateral  error. 

5. 6. 2. 4  Maximize  the  number  of  Strikes  achieving  target. 

5.7.0  Operator  teams  were  required  to  do  their  own  planning  and  schedulir 
of  RPVs.  The  planning  was  done  at  the  start  of  a  mission.  Operators 
were  provided  with  computer  print-outs  listing  original  ETAs  to  all 
waypoints  for  each  RPV  flight  plan.  Operators  were  also  permitted  to 
use  electronic  calculators  or  other  devices  of  their  own  choosing. 

5.8.0  The  three  targets  for  a  given  mission  were  chosen  randomly  from  a 
set  of  twenty-seven  targets  located  on  the  terrain  model.  The  targets 
were  in  the  form  of  small  white  disks  easily  identifiable  on  the  pilot'" 
video  monitor.  The  pilot  was  provided  with  maps  and  photographs  of  the 
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leit'aiii  model.  11  was  the  pilot's  task  to  locate  tiie  three  targets  pri ot¬ 
to  pert  ut :  i  nij  the  first  strike  and  without  the  l^tnefit  of  the  terrain  model. 
Wfien  not  in  the  cont i nuous-control /v ideo-on  modes  of  a  Terminal  Phase  for 
at)  RPV,  ttie  pilot  has  access  to  closed  circuit  video  from  one  of  the  Cn 
Route/Return  CRTs.  The  display  is  on  the  same  video  monitor  that  provides 
the  terrain  video.  This  display  provided  the  pilot  with  ongoing  mission 
information,  e.g.,  progress  and  ETA  of  a  given  RPV. 

6.0  SPECIFIC  OBdEaiJ/ESjAND  SYSTEM  PARAMETERS  INVESTIGATED 
6.1.0  The  Obje£tJvja  of  RPV  Study  VII  was  to  evaluate  RPV  system  capabilitie 
to  perform  a  simulated  mission  under  the  conditions  and  parameters  described 
dt'ove  and  to  investigate  the  effect  of  team  composition  (independent  vs. 
poiilerl  as  •  i  gnnient  s )  on  RPV  systems  performance  over  a  set  of  independent 
variables.  Ihe  RPV  system  referred  to  here  is  strictly  that  system 
postulated  by  the  RPV  system  simulation.  In  order  to  accomplish  this 
objective,  tfie  same  missions  tliat  were  executed  in  RPV  Study  V  were 
replicateil  with  pooled  constituted  teams  in  RPV  Study  VII.  As  will  be 
noted  below,  the  same  operators  that  performed  in  RPV  Study  V  also 
performed  in  RPV  Study  VII,  except  that  previously  they  fiad  been 
members  or  independently  constituted  teams.  Thus,  the  data  base 
collected  previously  under  RPV  Study  V  provided  the  basis  for 
comparison  with  the  "pooled"  condition. 

6.2.0  Five  independent  variables  of  RPV  system  performance  were 
varied  in  RPV  Study  VII  (in  order  to  replicate  RPV  Study  V  missions). 

Four  of  thi  variables  involve  riming  parameters  of  data  transmission. 

The  RPV  system  is  assumed  ti  operate  in  an  environment  where  data 
transmission  over  radio  frequencies  has  to  be  shared  with  other  users. 


so  that  a  tr-ansmi  ssion  time  slot  becomes  available  only  on  a  petiodif. 
basis,  and  only  then  can  data  be  transmitted.  (An  objective  of  RPV 
Study  V  was  to  obtain  an  estimate  of  what  the  timing  values  should  be.) 
These  five  independent  variables  are  listed  here  and  are  graphically 
portrayed  in  Figure  4. 

6.?.1  Telemetry  Data  Transmission  Time  -  When  data  can  be 
received  from  an  RPV  (slot  cycle  times  of  0.7,  ?.l,  3.5,  4.9 
and  6.J  seconds). 

6.3.?  Command  Data  Transmission  Times  -  When  commands  can  be 
sent  oi't  to  RPVs  (cycle  values  same  as  above). 

6.?. 5  Call  Delay  for  Modif icat ion/Window  Displays  -  When  an 
operator  calls  for  a  display,  the  display  is  delayed  in  accordance 
with  a  time  factor  (values  same  as  above). 

6.2.4  CRT  Non-Immediate  Information  Update  Time  -  Display  frame 
time  (2.8,  5.6,  3.4,  11.2  and  14.0  seconds). 

6.2.5  Number  of  RPVs  under  system  control  (9,  15,  21,  27,  and 
33). 

6.3.0  The  values  of  the  above  variables  were  identical  to  those  unec!  in 
RPV  Sti'dy  V.  The  reason  for  replicating  all  the  variables  ot  RPV  Study 
V  was  to  study  the  effects  of  team  composition  on  system  perf or-mance . 

In  RPV  Study  V,  each  En  Route/Return  operator  was  a  permanent  and 
independent  member  of  one  and  only  one  team.  In  RPV  Study  VII,  eacli  En 
Route/Return  operator  was  a  member  of  two  different  teams,  which  approx¬ 
imates  a  condition  where  teams  would  be  constituted  at  random  from  a 
limited  pool  of  operators.  The  number  of  available  operators  and 
scheduling  considerations  precluded  carrying  out  the  completely  random 
assignment  of  operators  to  teams. 
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6.4.0  Ttio  five  variables  were  varied  in  combination  with  eacfi  other 


according  to  a  Central  Composite/Fractional  Factorial  experimental  design 
(Coctiran  and  Cox,  1957).  This  type  of  design  allows  one  to  investigate 
a  large,  multivariate,  experimental  space  by  collecting  a  minimum  number 
of  observations.  A  single  execution  of  the  RPV  system  simulation  (i.c., 
one  simulated  mission)  constitutes  one  observation.  The  importance 
of,  or  interest  in,  the  results  of  RPV  Study  VII  lies  more  in  the  com¬ 
parison  of  the  results  of  RPV  Study  VII  to  those  of  RPV  Study  V,  as 
opposed  to  the  study  of  effects  of  specific  variables.  There  were  32 
observations  obtained  on  each  of  four  operator  teams  in  RPV  Study  VII, 
yielding  a  total  of  128  observations.  Cach  observation  required 
approximately  1  3/4  to  2  1/4  hours  of  execution  time. 

6.5.0  The  ojije^tive  _of__RPV  Study  VIII  was  to  investigate  individual 
operator  and  team  size  influences  on  RPV  system  performance.  The  RPV 
system  referred  to  here  is  strictly  that  system  postulated  by  the  RPV 
systems  simulation. 

6.6.0  The  make-up  of  the  variables  in  RPV  Study  VIII  was  different  from 
that  used  in  all  previous  studies.  As  in  several  previous  studies,  this 
study  too  assumed  that  the  RPV  system  operates  in  an  environment  wliere 
data  transmission  over  radio  frequencies  has  to  be  shared  with  other 
users,  so  that  a  time  slot  becomes  available  on  a  periodic  basis,  and 
only  then  can  data  be  transmitted.  The  four  timing  parameters  in  RPV 
Study  VIII  were  held  constant  as  follows; 

Telemetry  Data  Transmission  Time:  3.5  seconds. 

Command  Data  Transmission  Time:  3.5  seconds. 

Call  Delay  for  Window  Displays:  3.5  seconds. 

CRT  Don- Immedi ate  Information  Update  Time:  C.4  seconds 
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Team  size  was  one  of  the  variables  invest  iqated  in  this  study,  there 
being  teams  of  1,  2,  3  and  4  En  Route/Return  operators,  plus  one  pilot. 
Rather  than  varying  the  absolute  number  of  RPVs,  their  ratio  to  operators 
was  used  as  a  variable.  Because  the  program  permitted  a  maximum  of  35 
RPVs  to  be  simulated,  the  10:1  ratio  was  not  achieved  exactly  at  the 
four  operator  team  size  but  only  approximated.  All  other  ratios  arid 
team  sizes  were  exact.  There  were  ratios  of  2:1,  6:1,  and  10:1  RPVs  to 
operators.  These  ratios  maintained  a  constant  RPV  workload  per  operator 
across  team  sizes  and  within  each  ratio  level. 

7 . 0  OPERATOR  TEAMS 

7.1.0  Operators  were  obtained  from  universities  in  the  Dayton,  Ohio 
area.  They  were  required  to  be  undergraduates  for  program  longevity 
purposes  and  to  have  at  least  a  "B"  grade  point  average.  However, 
because  many  had  been  incoming  freshmen  at  the  start  of  the  research 
program  and  there  were  occasional  immediate  needs,  the  grade  requirement 
was  sometimes  relaxed.  Teams  were  comprised  of  five  operators  (four  En 
Route/Return  operators  and  one  Pilot)  in  RPV  Study  VII,  while  team  size 
was  one  of  the  experimental  variables  in  RPV  Study  VIII. 

7.2.0  Individual  operators  acquired  a  minimum  of  5  months  training.  All 
operators  had  completed  this  initial  training,  and  had  participated  in 
one  or  more  RPV  studies  prior  to  RPV  Studies  VII  and  VIII,  so  that  they 
w-^re  considered  to  be  highly  experienced  and  skilled  in  handling 
simulated  RPV  missions.  All  operators  had  participated  in  RPV  Study  V. 
Pilots  were  given  additional  training  (2  weeks)  in  instrument  flight 
simulators,  as  well  as  controlling  the  camera  over  the  terrain  model.  In 
addition,  each  team  executed  a  number  of  practice  missions  before  actual 
mission  runs  began.  Formal  data  collection  was  started  after  an  unanimous 
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consensus  ot  the  teams  that  they  were  ready  to  proceed  was  obtained 
(Because  or  tt)e  complexity  ot  the  simulation,  the  operators  were  more 
knowledgeable  about  their  tasks  and  procedures  than  the  investigators. 

At  tfie  present  levels  of  the  state-of-the-art  in  systems  research,  it  is 
virtually  impossible  to  develop  formal  training  criteria  for  "asymptotic 
performance,"  etc.) 

8.0  RPV  STUp^^I  RFJUIJS 

8.1.0  The  purpose  of  RPV  Study  VII  was  to  compare  independent  vs.  pooled 
constituted  team  performance,  thus  the  data  analysis  will  be  geared 
appropriately  for  that  intent. 

8.1.1  A  table  (similar  to  Table  1,  Aume,  Mills,  et  al.,  1977)  listing 
means  and  standard  deviations  for  botli  RPV  Study  V  (independent)  and  RPV 
Study  VII  (pooled)  was  prepared  for  64  dependent  variables.  A  comparison 
of  the  values  disclosed  that  the  means  had  an  overall  average  change  of 
1.012%  and  the  standard  deviations  had  a  reduction  in  magnitude  of 
9.43%  from  RPV  Study  V  to  RPV  Study  VII.  To  determine  the  significance 
of  these  changes,  Chi  square  tests  were  conducted.  For  the  means:  38 
variables  were  better  (toward  improved  average  performance)  in  RPV  Study 
VII  and  26  were  better  in  RPV  Study  V. 

x2  =  (38-32)2  +  (26-32)2  =  2.25  (d.f.  =  1)  and  not  sionificant. 

32  32 

For  standard  deviations:  46  variables  were  better  (lower)  in  RPV  VIII, 
and  18  were  better  in  RPV  Study  V. 

x2  =  (46-32)2  +  (18-32)2  =  12.25  (d.f.  =  1)  and  significant  at  <0.01. 

J2  37 
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8.1.2  Since  the  above  procedure  may  have  violated  the  assumption  of 
i ndepi.-iiiieiu  among  dependent  variables,  an  intercorrelation  scan  of 
dependent  variables  was  performed  starting  with  "difference  between  ETA 
and  AfA  at  S  waypoint"  and  using  an  intercorrelation  cutoff  value  of 
0.30.  From  this  scan,  58  variables  were  retained  (i.e.,  all  inter- 
correlations  were  0.30  and  variances  accounted  for  10%),  including  the 
important  variables  of  "proportion  of  Strikes  successfully  handed  off  to 
pilot"  and  "range  from  EW  to  Strike  when  Strike  is  at  target."  Repeating 
the  Ctn  square  tests  for  the  58  retained  variables: 

For  moari^;  36  variables  were  better  in  RPV  Study  VII  and  22  were  better 
in  RPV  Study  V. 

X-  (46-29)^  I-  (22-29)2  .  3.33  (d,f,  =  i )  and  not  significant 

.'^9  T9  '  ■ 

t-or  s tan. i, ini  deviations:  46  variables  were  better  in  RPV  Study  VII 
aiiu  13  variables  were  better  in  RPV  Study  V. 

a2  (46-29)2  f  ('2-46)_2  -  19.93  (d.f.  =  1)  and  significant  at 

2'9  '  ■  '29 

<0.0!. 

From  results,  it  may  be  concluded  that  the  overall  mean  performance, 

comp  i-' inq  I  nde()ondent  vs.  pooled  constituted  teams,  does  not  change.  On 
trie  otii.i  iiond,  tfie  performance  variability,  on  a  team  basis,  exhibits 
a  s  iqn  I  f  leant  decrease. 

0.1.3  tAplanation  of  this  observation  can  be  sought  in  how  individual 
operaiurs  contribute  to  inter -operator  variability.  In  the  case  of  the 
independently  constituted  teams,  each  subject  contributes  to  only  one 
team,  and  each  team  consists  of  different  individuals.  In  the  case  of 
the  pooled  constituted  teams,  the  same  individual  belongs  to  more  than 
one  team  and  so  the  contribution  to  those  teams  is  the  same.  Thus,  the 
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variability  in  performance  across  pooled  constituted  teams  relative  to 
independently  constituted  teams  is  reduced  approximately  10%.  Average 
performance  as  measured  by  the  means  of  the  dependent  variables  appears 
to  reamin  unchanged.  This  latter  result  would  be  expected  if  one  assumes 
that  one  operator's  performance  was  stable  and  not  influenced  by  team 
composition;  an  assumption  that  tends  to  be  confirmed  by  the  results  of 
RPV  Study  VIII  below. 

9.0  RPV  STUDY  VIII  RESULTS 

9.1.0  For  the  study  of  effects  of  individual  operators  and  the  effects 
of  team  size  on  the  performance  of  the  simulated  RPV  system,  certain 
important  variables  were  selected  for  close  scrutiny.  The  criterion  for 
selection  was  that  one  could  reasonably  expect  operator  actions  to  have 
an  influence  on  the  variables,  as  opposed  to  a  variable  whose  value  is 
determined  by  program  parameters  and  which  is  largely  independent  of 
operator  actions.  For  example,  RPV  cross  track  error  is  to  a  large 
extent  under  the  control  of  the  automatic  heading  correction  function. 

The  following  variables  were  chosen;  Differences  between  ETA  and  ATA  at 
target  for  strike  PPVs;  proportion  of  strike  RPVs  handed  off  to  pilot; 
manual  heading  ctianqes  per  strike  RPV,  attempted  .and  transmitted;  range 
from  strike  to  EW  RPVs  with  strike  at  target;  and  number  ot  RPVs  assigned 
to  an  operator  at  the  start  of  each  mission. 

9.1.1  The  results  were  reviewed  and  the  following  behavior  of  the 
variables  were  observed: 

9.1.1.  I  Difference  between  ETA  and  ATA  at  target  for  strike 

RPVs:  The  mean  value  for  this  variable  was  4.41  seconds, 

with  a  range  from  3.0  to  7.0  seconds.  An  analysis  of  variance 


(team  size  X  RPV:  Operator  ratio  X  subjects)  was  performed 
on  the  data  and  the  RPV:  Operator  ratio  was  the  only  factor 
found  to  be  significant  at  p<0.01  (F=  b.l89,  df  =  2,72). 

From  the  plot  shown  in  Figure  5,  it  can  be  seen  that  the 
difference  decreases  with  increasing  ratio;  but,  from  a  practical 
point-of-view,  this  tendency  is  very  slight,  approximately  one  serond 
or  less.  It  can  also  be  seen  in  Figure  5  that  team  size  did 
not  have  a  significant  effect  on  the  dependent  variable.  This 
was  also  the  case  for  individual  operators'  performance  on  this 
variable  as  a  function  of  team  size  (i.e.,  the  operator  X  team 
size  interaction  was  nonsignificant). 

9.  1.1.2  Manual  heading  changes  per  stike  RPV,  attempted  and 
transmitted:  In  both  case,  the  data  indicated  a  rather  level 
performance  over  team  sizes,  and  a  slight  decrease  as  the  ratio 
of  RPVs:  Operators  increased.  An  analysis  of  variance  was 
performed  (same  as  in  9. 1.1.1)  and  disclosed  that  the  RPV: 

Operators'  ratio  was  significant  variable  (p  O.OOi,  F  -10.98 
df  =  2,72).  No  other  main  effects  or  interactions  were  found 
to  be  significant.  Attempted  heading  changes  had  a  mean  value 
of  1.91  and  a  range  from  0.0  to  4.0.  The  behavior  of  this 
variable  is  understandable;  as  an  operator  acquires  more 
RPVs  to  handle,  the  attention  and  actions  devoted  to  any 
individual  RPV  would  become  less.  The  proportion  of  acceptable 
heading  changes  actually  transmitted  to  those  attempted  did  not 
exhibit  any  obserable  changes. 

9. 1.1.3  Range  from  strike  to  EW  RPVs,  strike  at  target:  Over 
the  RPV:  Operator  ratios  and  team  sizes,  on  the  average,  there 

was  little  change.  Performance  on  this  variable  tended  to  be 
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RPV  TO  OPERATOR  RATIO 

Figpjre  5.  DIFFFFEgCE  BETUFE:i  ETA  ArjD  ATA  AT  TARGET  TOR  STRIKE  RPVs 


quite  erratic  and  was  not  conducive  to  a  systematic  analysis. 

The  obtained  performance  was  probably  the  result  of  shifts  in 
EW  RPV  availability  during  real-time  and  as  malfunctions  occurred 
The  mean  was  4.05  NM  and  the  range  was  from  0.0  NM  to  20.9  NM. 

9.  1.1.4  Proportion  of  strike  RPVs  handed  off  to  pilot:  The 
mean  value  of  this  variable  was  0.89  with  a  range  from  0.50  to 
1.00.  An  analysis  of  variance  (same  as  in  9. 1.1.1)  was  performed 
The  RPV:  Operator  ratio  was  found  to  be  significant  (p  0.001, 

F  =  20.05,  df  =  2,72)  as  well  as  team  size  (P  0.01,  F  =  4.21, 
df  =  3,72).  From  the  data,  the  following  regression  equation 
was  computed:  Proportion  =  0.94497  -  0.02043  X  Ratio  +  0.02661  X 
T.  size.  A  plot  of  this  variable  (Figure  6)  indicates  that  the 
proportion  is  very  close  to  unity  at  the  2:1  RPV:  Operator  ratio, 
and  gradually  drops  off  as  the  ratio  is  increased.  However, 
there  is  less  of  a  drop-off  at  the  large  team  sizes.  Such 
behavior  could  be  expected,  as  the  amount  of  actions  to  be 
taken  by  the  operator  increases  with  increasing  ratio  and  for 
various  reasons,  some  strike  RPVs  are  not  handed  off.  One  of 
the  reasons  may  be  that  some  cf  the  RPVs  were  lost  during  the 
En  Route  leg  and  thus  were  not  available  for  handing  off.  The 
operator  X  team  size  interaction  was  found  to  be  nonsignificant 
indicating  that  although  this  variable  was  affected  by  team  size, 
individual  operators'  performance  was  not.  This  variable,  as 
opposed  to  the  previous,  falls  in  the  team-centered  category 
because  it  involves  coordination  among  the  operators. 
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9. 1.1. 5  Number  of  RPVs  assigned  to  an  operator.  Strikes  and 
EW;  Tins  variable  was  looked  at  more  to  establish  what  the 
operators  had  been  doing  rather  than  with  a  scientific  interest. 
From  the  data,  it  became  obvious  that  under  1-,  2-,  and  3-person 
team  sizes,  each  operator  handled  a  subset  of  the  RPVs  consisting 
of  both  strike  and  EW  types.  Under  the  4-person  team,  they 
apparently  reverted  to  the  division  of  labor  as  it  had  been 
practiced  in  previous  studies  in  which  one  operator  would  handle 
strike  RPVs  at  all  three  targets,  and  the  remaining  three  operators 
would  handle  the  support  RPVs,  each  operator  for  a  specific  target. 
With  a  few  exceptions,  the  values  were  either  1,  3,  or  5  RPVs 
assigned  which  reflect  the  RPV:  Operator  ratios  and  the  equal 
number  of  strike  and  EW  RPVs. 

10.0  CONCLUSIONS 

10. I. 0  Before  going  any  further,  two  effects  must  be  mentioned:  The 
experience  level  of  the  subjects,  and  the  nature  of  the  system.  To 
restate  what  was  said  in  paragraph  7.0,  the  operators  had  accumulated  a 
great  deal  of  experience,  each  having  participated  in  at  least  two  RPV 
studies  (and  some  operators  even  more)  prior  to  RPV  Study  VIl.  Thus, 
they  were  highly  knowledgeable  and  skilled  in  the  operation  of  the  RPV 
system.  Second,  it  must  be  remembered  that  we  are  dealing  with  a  system 
that  is  capable  of  performing  completely  automatically.  It  is  possible 
for  an  RPV  to  fly  from  launch  to  recovery  without  operator  intervention. 
Operator  intervention  is  required  only  to  accomplish  the  strikes  on  the 
target  during  the  terminal  phase;  and  it  is  at  times  needed  to  maintain 
systems  navigation  accuracy  within  prescribed  limits  and  other  prescribed 
experimental  requirements. 
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1.  The  stability 

of  pt'i'f  •  r'l- :ini  r  also  , •.■.plains  why  average  per  f  orinatice  nid  not,  rhange  in  RPV 
‘  fudy  v;i.  l!  I  .in  alsu  acc.o  int.  for  the  fact  that  large  differences  were 
not  ol  tainod  Potwei.Ti  .-I-  and  4-pcrson  teams  despite  the  fact  that  team 
Strategies  n?-  opetaiing  procedures  had  been  changed  (see  paragraph  9. 1.1. 5 
and  1.  .  d  .  3  lit.'  low  ' . 

10.3..  I'tio  results  suggest  that  tliere  are  two  classes  of  operator  tasks 
involved  in  the  system  under  investigation. 

10.3.,. .1  The  t  irst  class  can  be  referred  to  as  "leani-r.entercu" 
tasks.  These  are  tasks  that  involve  some  degree  of  coordination 
■amon.j  operators  and  are  exemplified  by  the  variable  "Proportion 
of  btrike  RPVs  Handed  Off  to  Pilot"  (see  paragraph  9.1.1.?). 

^fiis  variable  is  probably  the  only  one  in  this  system  whose 
performance  depends  upon  operator  coordination  or  on  a  team- 
centered  task.  It  was  chosen  tor  examination  for  this  reason 
and  was  found  to  he  the  only  variable  that  s i gn i f i c anf 1 y  improved 
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in  performance  as  team  size  was  increased.  However,  even  in 
the  case  of  tttis  variable,  individual  operator  performance 
remained  stable  such  that  it  was  unaffected  by  team  size. 
Apparently,  the  efficiency  of  performing  the  coordination 
function  improved  as  team  size  was  increased. 

10.2.i:‘.?  We  have  chosen  to  call  the  second  class  of  tasks 
“Ofjer ator-Centered"  tasks.  Controlling  a  system  using  th^'-se 
tasks  can  be  thought  of  as  involving  only  parallc'l  processing. 
The  performance  of  one  operator  thus  has  a  fairly  simple, 
direct  influence  on  the  average  performance  of  a  team  and 
is  largely  independent  of  the  performance  of  otlier  team  members. 
Tills  class  of  tasks  is  exemplified  by  the  variablr  '-  "Hi f f erenr  c- 
Betwecn  ETA  and  ATA  at  Target  for  Strike  RPVs"  and  "Manual 
Patches  Per  Strike  RPV,  Attempted  and  Transmitted,"  When 
these  variables  were  examined,  it  was  found  that  therf  wa', 
no  influence  of  team  size.  This  result,  in  addition  tn  the 
fact  that  individual  operators  did  not  exhibit  't,v  -  .st-r  mo 
differences  in  performance  over  team  size,  led  tr  .  ^nr  li.c. 
that  operator-centered  tasks  arc  not  only  thovo  inat  is- »  ►, 
parallel  with  other  operators'  tasks  but  are  also  highly 
stable  and, thus,  we  1  I -trained . 

10.2.3  Since  none  of  the  variables  examined  exhibited  significant 
differences  among  operators,  it  can  be  concluded  that  there  were  no 
practical  differences  in  perfor'mance  between  male  and  female  operator';.. 
(NOTE:  Tiiis  has  been  a  consistent  result  throughout  all  of  the  RPV 
system  simulation  studies.) 
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over  f  om  previour  studios  ( u  I  ttiouijti  it  is  possitjlo  that  ttn-  ran  y-ovoi 
was  perceived  as  necessary).  It  consisted  ot  one  Cn  Rout e/Rot ui'n  i)pci  itor 
tiandlinq  all  strike  RPVs,  and  eacti  of  ttii-  roniaininq  throe  operators  fiandiiop 
tile  siippairt  RPVs  at  one  ot  the  three  targets.  Witti  a  team  size  of  one 
operator,  tih'»'o  can  be  no  division  oi  labor  and  tiie  operators  must  have 
decided  tiiat  it  wcjuld  not  be  useful  (ttie  activities  at  3  targets  are  to  be 
d  I  st  r  i  t)  .t>‘d  iH'otig  tin  s.jpport  operators)  or  et  tic  lent  to  practice  it  at  ?- 
anc  tuam  ■  izes. 

IG.'.e  i i  t  y  in  ti-.'  cbserved  variables  is  sometimes  extreme  and  i" 

probably  dia'-  to  tin-  c  n  iability  of  dynai  'c  events,  (e.g.,  tlie  loss  of  an 
RPV  duo  to  a  IS  i  1 1 unc t  ion ing  subsystem).  The  fact  that  unpredictable  events 
can  occur  in  a  system  over  time  is  another  reason  why  systems  are  a  difficult 
object  to  study. 

10.2.6  The  general  conclusion  from  the  foregoing  is  that  for  the  purpose < 
of  modelling  and  simulation  of  operator-centered  (highly-trained,  parallel- 
processing)  tasks,  team  size  appears  to  have  little  influence.  This  obvi¬ 
ously  may  not  hold  for  what  can  be  termed  team-centered  (coordination  ot 
decision  making,  serial  processing)  tasks,  which  suggests  a  course  of 
action  for  future  research  where  one  might  establisti  the  delineation  points 
among  classes  of  tasks.  This  should  be  accomplished  in  terms  of  the  onset 
of  significant  changes  in  performance,  so  that  good  definitions  of  eacfi 
class  of  tasks  can  be  developed  in  operational  terms.  Also,  it  appear^ 
that  estimates  of  individual  performance  on  operator-centered  tasks  based 
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(in  I  j  tOfatLice  stiidi'^s  may  be  adequate  as  input  data  to  system  modf-ls  and 
t  ast-t ime  s imul at  ions  . 


I  I  .  0  riJTURF  PLANS 

ll.l.b  It  was  noted  th.!l  t  hr  wuiv  baid  level  on  tlie  operators  did  riot 
appear  to  be  excessive.  In  an  if  tempt  to  quantify  this  statement,  or  at 
least  to  qet  a  better  insiqlit  intfi  tliis  betiavior  phonomenon.  RPV  Study 
IX  will  be  conductf.'ii  wiierein  a  Sfcomlary  (or  auxiliary)  task  will  be 
introduced  into  the  RPV  system  simulator  and  the  performance  of  the 
operators  on  it  will  be  measured.  The  primary  task  will  be  cnntrollinq 
a  standard  RPV  Study  VII  type  of  mission  with  strike  and  [W  type  RPVs. 
The  auxiliary  task  will  consist  of  maintaining  Low  Recce  type  RPVs  on 
course  with  manual  course  corrections. 
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